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1. Introduction 


An extensive literature on functional data analysis techniques emerges in 
the last few decades. In particular, in the functional linear regression con¬ 


text, one can refer to the papers [ll|; [l2|; [l 




among 


others. We particularly refer to the flexible approach recently presented in 
30l | to approximate the regression function in the case of a functional pre¬ 


dictor and a scalar response, based on the Projection Pursuit Regression 
principle. Specihcally, an additive decomposition, which exploits the most 
interesting projections of the prediction variable to explain the response, is 
derived. This approach can be used as an exploratory tool for the analysis of 
functional dataset, and the dimensionality problem is overcome. In the func¬ 
tional nonparametric regression framework we refer to and j^, among 
others. Asymptotic results, in particular, uniform consistency, in the purely 
nonparametric context are derived in for a kNN generalized regression 
estimator. For more details we refer to the reader to the nice summary on the 
statistics theory with functional data in j^, and the references therein. New 
branches of the functional statistical theory in a univariate and multivariate 
framework are collected in j^. 

Functional Analysis of Variance (FANOVA) extends the classical ANOVA 
methods, allowing the analysis of high-dimensional data with a functional 
background. Due to the vast existing literature on functional data statistical 
analysis techniques, FANOVA models have recently gained popularity and 
related literature has been steadily growing. For comprehensive reviews we 


refer, for example, to and j^. In particular, FANOVA model htting 


and its component estimation have been addressed in several papers 


see 


35|; (39l; |4ll; [42 


58| . among others). 


In the context of hypothesis testing from functional data, [2^ discussed 
the difficulties of generalizing the ideas of multivariate testing procedures to 
the functional data analysis context. A powerful overall test for functional 
hypothesis testing, based on the decomposition of the original functional data 
into Fourier and wavelet series expansions, is proposed in j^. In this paper, 
the adaptive Neyman and wavelet thresholding procedures of are respec¬ 
tively applied to the resulting empirical Fourier and wavelet coefficients. The 
general philosophy of the presented methodology exploits the sparsity of the 
signal representation in the Fourier and wavelet domains, allowing a signih- 
cant dimension reduction. Somewhat similar approaches were considered in 


and |25|]. In |3^ a maximum likelihood ratio based test is suggested for 
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functional variance c omp onents in mixed-effect FANOVA models. The pro¬ 


cedures presented in j27j are applied to the mixed-effect FANOVA model in 


56l |. An alternative asymptotic approach, inspired in classical ANOVA tests, 
is derived in [l^, for studying the equality of the functional means from k 
independent samples of functional data. In [l| and the testing problem in 
the mixed-effect functional analysis of variance models is addressed, develop¬ 
ing asymptotically optimal (minimax) testing procedures for the signihcance 
of functional global trend, and the functional hxed effects, from the empir¬ 
ical wavelet coefficients of the data (see also j^). Statistical shape analysis 
methods are applied in to developing a neighborhood hypothesis testing 
procedure to establish that a mean is in a specihed ^-neighborhood. Re¬ 
cently, in the context of functional data dehned by curves, considering the 
L^-norm, an up-to-date overview of hypothesis testing methods for functional 
data analysis is provided in including functional ANOVA, functional lin¬ 
ear models with functional responses, heteroscedastic ANOVA for functional 
data, and hypothesis tests for the equality of covariance functions, among 
other related topics. 

Most of the above-cited papers are based on dimension reduction tech¬ 
niques, applying numerical projection and smoothing methods. Classical 
ANOVA results are then considered for projections in an univariate and mul¬ 
tivariate framework. For example, smoothing splines ANOVA (SS-ANOVA) 
has the restriction of considering the time as an additional factor which im¬ 
plies independence in time. This restriction was removed in [l^ and (j^ . 
using the RKHS theory. This theory is also applied in the present paper 
to remove independence assumption on the functional zero-mean Gaussian 
error vector term. Since the aim of this paper is to provide explicit results 
within the inhnite-dimensional probability distribution setting, we restrict 
our attention to the Gaussian case. It is well-known that Gaussian measures 
on Hilbert spaces can be identihed with inhnite products of independence 
real-valued Gaussian measures (see, for example, |22|). Hence, one can work 
with inhnite series of independent real-valued random variables. Indeed, 
such an identihcation, jointly with the acute formulation of Cramer-Wold 


theorem derived in [1^, can be applied to implement the multiway ANOVA 


methodology for functional data proposed in 0. which does not require 
the Gaussian assumption although the hypothesis of independence is main¬ 
tained (see 1^). Here, we also apply the results in j^, on characteristic 
functions of quadratic functionals constructed from Gaussian measures on 
Hilbert spaces, for the derivation of the probability distribution of the func- 


3 











tional components of variance, and of the test statistics formulated for linear 
hypothesis testing. 

In all above-cited papers, a Hilbert-valued formulation of the traditional 
analysis of variance has tended to be missing, since the Functional Analysis 
of Variance derived in Specihcally, in 641. the following L9([0. Iji-valued 
hxed effect model is considered: 


Y(f)=X/3(t) + a6(t), te[0,l], (1) 


where X = is a n x p hxed effect design matrix. The response Y is a 
n-dimensional vector of independent Gaussian T2([0, l])-valued components 
with i?[Y] = X/3, and with T2([0,1]) denoting the space of square integrable 
functions on [0,1]. The unknown functional parameter (3{t) takes its values in 
the space ^^([0,1]) of vectorial functions with square integrable components 
on the interval [0,1]. The error term e is an u-dimensional T2([0, l])-valued 
zero-mean Gaussian random variable with covariance matrix operator 


E [[£i(-),...,e„(-)]^[£i(-),..., £„(•)]] = diag(i?) 
E[ei G) ei] ,..., E[ei ® £„] 

! ! ! ? 

E[en®ei] ,..., E[en®en] 


( 2 ) 


where [-j^ denotes transposition, diag(i?) is a diagonal matrix operator with 
non-null functional entries, in the diagonal, given by the compact and self- 
adjoint operator i?, dehned on L 2 ([ 0 ,1]), i.e., E[ei ® ej] = 6ijR, with 6 
denoting the Kronecker delta function. Here, a represents a scale parameter. 
Note that, in the Gaussian case, = n(trace(i?)) < oo, with trace(-) 

denoting the trace of an operator, which implies that R is in the trace class 
(see, for example, j^, Ghapter 1). 

This paper extends the results derived in to an arbitrary Hilbert space 
H (not necessarily given by L2([0,1])), and to the case where £ has correlated 
/f-valued zero-mean Gaussian components. Specihcally, a generalized least- 
squares estimator of valued parameter f3 is obtained. The functional 
mean-square error is computed in the RKHS norm. It is proved that, for 
an orthogonal hxed ehect design matrix, the statistics minimizing the func¬ 
tional quadratic loss function takes its values in the functional parameter 
space H^. The analysis developed here is referred to a common orthonormal 
eigenvector system, which is assumed to be known, providing the spectral 
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diagonalization of the covariance operators of the error components. This 
assumption is satisfied, for example, by the system of stochastic differential 
or pseudodifferential equations introduced in Section 12.11 with fixed effect 
hf-valued parameters. In this case, the common orthonormal basis of eigen¬ 
vectors of H can be determined from the differential or pseudodifferential 
operators defining such a system of equations (see Section [^?T] below). 

Another important issue addressed in this paper is the construction of 
a matrix operator providing a suitable functional linear transformation of 
our observed TT”-valued response (see Section 14.11) . in order to ensure the 
almost surely finiteness of the total sum of squares, the sum of squares due 
to regression, and the residual sum of squares. Under this transformation, 
the moment generating and characteristic functionals of these three statistics 
are derived. Linear hypothesis testing is also addressed, in terms of a suit¬ 
able matrix operator class defining a linear transformation of the Lf-valued 
components of f3, to test some contrasts. 

The outline of the paper is as follows. Section [2] introduces the analyzed 
Hilbert-valued multivariate Gaussian fixed effect model with correlated error 
components. In Section [31 the generalized least-squares estimator of the 
LfP-valued hxed effect parameter f3 is derived, providing sufficient conditions 
for the almost surely hniteness of its TT^-norm. The transformed functional 
data model is constructed in Section jH The almost surely hniteness of the 
functional components of variance is then proved. Their moment generating 
and characteristic functionals are derived in Section O Linear hypothesis 
testing is addressed in Section |6] in a multivariate Hilbert-valued Gaussian 
framework. Final comments are provided in Section [3 

2. The model 

Let iL be a real separable Hilbert space endowed with the inner product 
(•, ■)jj-. Gonsider the following Hilbert-valued multivariate hxed ehect model; 

Y(.) = X/3(.) + ffs(.), (3) 

where Y(■) = [Yi(-),..., Y„(-)]^ is an iL"'-valued Gaussian random variable, 
with E[Y] = X/3. The //"'-valued error term £{■) = [ei(-),... ,£n(-)]'^ is such 
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that E[£\ = 0, and has covariance matrix operator 


ee = E[[efl-),. 



) 1 ] 


E[ei'^ei] , 

■ ■ ■, E[ei (g) Sn] 


Rsiei 1 • 

■ 1 ReiCn 

E[en(S)ei] , 

. . . , E [Sn £n] 


RsnSl 1 ■ 

■ 1 RsnCn 


where R£^ei i = 1,..., n, are compact and self-adjoint operators on H, in the 
trace class. As before, a represents a scale parameter. In the subsequent 
development, we assume that Re^e^ i = l,...,n, are strictly positive. For 
i 7 ^ j, with i,j G {!,..., n}, RsiSj denotes the cross-covariance operator 
between ei and Sj. Here, /3(-) = [/9i(-),..., /9p(-)]^ G and X is a real¬ 
valued n X p matrix, the fixed effect design matrix. 


Remark 1 Note that the Gaussian error term of model ^ has covariance 
matrix operator which in the particular case of Re^cj = 0, for i ^ j, and 
i,j G {!,..., n}, and = R, for i = 1,... ,n, coincides with the covari¬ 
ance operator ^ of the error term in m, as given in W^J - Thus, equation 
provides an extension of model (If), going beyond the space F^([0,1]), and 
the independence and homoscedastic assumptions. 


Remark 2 Further research can be developed considering the non-linear and 
non-gaussian case, and a more flexible class of design matrices. Fixed design 
assumption is very common in the standard multiple (finite-dimensional) re¬ 
gression theory, as well as it can be justified in the functional regression 
setting (see, for exam^e, f^]). Partial linear regression is formulated in the 
functional setting in displaying a better performance than the functional 
linear regression and functional nonparametric regression (see, for example, 
Ul: Ml: &)■ Recent advances have extended the linear approach by combin¬ 
ing it with link functions, considering multiple indices. But this approach still 
requires to be improved. The authors in (ij) introduce a new technique for 
estimating the link function in a nonparametric framework. An approach to 
multi-index modeling using adaptively defined linear projections of functional 
data is proposed, which enables prediction with polynomial convergence rates. 
In Ifis], the framework of functional regression modeling with scalar response 
is considered. The unknown regression operator is approximated in a semi- 
parametric way through a single index approach. Possible structural changes 
are taken into account in the presented approach. In particular, non-smooth 
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functional directions and additive link functions are used for managing rup¬ 
tures by applying Single Index Model. 


In the subsequent development, the following assumption is made: 

Assumption AO. The auto-covariance operators ReiSi, i = 1,.. .n, admit a 
spectral decomposition in terms of a common complete orthogonal eigenvec¬ 
tor system {(t)k\k>i dehning in H the resolution of the identity 4>k®4>k- 

Let {pkii /c > 1}, * = 1,..., ri, be the standard Gaussian random variable 
sequences such that = VXkiVki, k > 1}, with Reiei4>k = hi4>k, for 

i = 1,... ,n. The following orthogonality condition is assumed to be satished: 


E[r]kiVpj] = 5k,p, k,peN-{0} i,j = l,...,n, 


( 5 ) 


where 6 denotes, as before, the Kronecker delta function. 

Remark 3 Assumption AO provides a semiparametric definition of the 
elements of the class of covariance matrix operators characterizing the cor¬ 
relation structure of the functional vector error term. Specifically, these 
elements admit an infinite series representation in terms of a seguence of 
finite-dimensional matrices {A*,, k >1} (the parametric part), introduced in 
eguation / f7^) below, with respect to a resolution of the identity of the Hilbert 
space H (the non-parametric part), given by {fk, k > 1}. 

Under Assumption AO, the following orthogonal expansions hold for 
Si, i = 1,... ,n, in terms of their common covariance operator eigenvector 
system {0*,, /c > 1} : 


OO 



( 6 ) 


k=l 


In addition, from (|6]), using the assumed orthogonality condition (|5]) 


OO 




k=l 
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Hence, the covariance matrix operator (0]) can be rewritten as: 

<Pk . <Pk 


Rr 


Y^T=1 [-^fcnAfcl] Vfc (8 0fc . J2T=1 ^kn4>k (8) 4>k 


( 8 ) 


2.1. Example 

An example of zero-mean Gaussian i/’^-valued random variable e satisfy¬ 
ing Assumption AO is now constructed considering the space H = 
Specifically, define e as the valued zero-mean Gaussian solution, in 

the mean-square sense, of the system of stochastic fractional pseudodifferen¬ 
tial equations 

fi{C)ei = ei, z = l,...,n, (9) 

where C is an elliptic fractional pseudodifferential operator on of 

positive order s G M+, whose inverse belongs to the Hilbert-Schmidt operator 
class on and fi, i = 1,... ,n, are continuous functions. Here, e^, i = 

1,... ,n, are zero-mean Gaussian iJ-valued random variables such that = 
{4>k,^i), k > 1, i = 1,... ,n, satisfying the orthogonality condition 
(|5]). From spectral theorems on functional calculus for self-adjoint operators 
on a Hilbert space H (see, for example, j^, pp. 112-126), the covariance 
operators /?£,.£. = i = l,...,n, with A* denoting the 

adjoint of operator A, admit a spectral kernel representation in terms of the 
eigenvectors {(pk, A: > 1} of operator C in the following form: For i = 1,... ,n, 
and for h G FT = 

OO 

Reiei{h){^) = ^|/i(Afc(£))r^(0fc,h)^2(Rd)0fc(x), XGM”^, (10) 

k=l 

where Afc(£), F > 1, are the eigenvalues of operator C. In addition, under the 
orthogonality condition ([5]), for h G iF = F^(M'^), 

OO 

Reie,{h){^) = ^ \fi{\k{C))fj{\k{C))\~^ (0fe, 0fc(x), X G . (11) 

fe=l 


Let us now hx some notation and preliminary results for the subsequent 
development. By "H = FT” we will denote, as before, the Hilbert space 




of vector functions in i/" with the inner product (f, g)-^ = {fiyddn ’ 

for f = [/i, • • •, /n]^, g = [ 91 , ■ ■ ■, Qn]^ £ 'H. Given an orthonormal system 
{(j)k, k > 1} oi H, we denote by = (<h^)fc>i, with —)■ M"', 

the projection operator into such a system of the components of any vector 
function f G H"- as follows: 

«-(f) = (4>:(f)H>i = («»>, 

= .(12) 

\ / fc>l \ / fc>l 

The inverse operator $ of satisfies = 1h^, i.e., —> if", is 

given by 


$ 


(ifkl, • • • , /fcn)^j 


k>l 


^ ^ • • • ) ^ ^ fkn(pk 


(13) 


.fc=i 


k=l 


for all , fkn)^^ G [P]'^. Let us consider a matrix operator A. 

with functional entries defined by the operators Aij = lkij4>k ® 4>k, 


with < 00 , and Aij{f){g) = J2T=ilkij {f, h) h (9, h) h ^ 

1,... ,n, for f,g^H. Then, the following notation will also be used 


= 


7fcii 

Tfcnl 


'ykln 

'^knn 


k>l 


Reciprocally, given an infinite sequence of nxn matrices 


7fcii 

'^knl 


$ 


7fcii 


'yknl 


7fclr; 


'Jkn 




k>l 


1 7fcii0fc ® 4^k 


1 'yknl^Pk ® (j^k • • 

Thus, from (|H]), considering ffTT)) - (fT^ . 

Afci ... vAfciA 

kn 


] '^knn4^k ® 4^k 






All 


A 


kn 


- i-^k) 


k>l 1 


hJ = 

(14) 

'Tfcln 

'yknn 


(15) 


(16) 


k>l 


k>l 
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and from equations (fT^ and flT5D . 


Reems) 


oo 

EI(9‘ ) 4^k) H ) • • • ) {dni 4^k) 4^k)}{ ) • • • ) {fm 4^k) }{\ 

k=l 
oo 

, (17) 

k=l 


for all f, g G "H = 77", with A^/^ := (AY)k>i, gk = (gki, ■ ■ ■, gkn)'^ and 
ffc = (fki, ■ ■ -JknV, for every 7 > 1. Thus, = A^/^ 

Note that from Cauchy-Schwarz inequality. 


oo 

OO 

1/2 

OO 

1/2 


k=l 

; 1 

Wl 
_ 1 


Afcj 

.k=l 

< OO, Z,J = 1,.. 

.,n 


(18) 


since -E||£,||^ ^ < oo, for i ^ 1,..., n, and hence, i ^ 

l,...,n, are positive self-adjoint trace covariance operators, i.e., Xki > 0, 
7 > 1, and Y^^=i ^ki < cxo, for z = 1,..., n. Consequently, 

OO 

= trace (Afc) < cx). (19) 

k=l 

From equation (1T71) . for every f = (/i,..., fn)'^ €77 = 77", 

g(.) = 4> 6 (20) 

Hence, ^»*(g) = (Aj.'^^ffc) , and 

V / A:>1 

$*C« = (Ap'h : «« («) = W(^) ^ «. «*C8 = (fi)s>i ■ (21) 

\ / k>l ~ 


trace 


5^a^ 


Lemma 1 The inverse R^e of the matrix covariance operator satisfies 

OO 

Rfei'4’)M = ^l^k^'^k, ( 22 ) 

k=l 
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( 23 ) 


for all V’) ^ Equivalently, is such that 

-K’-R.-,'* = (A^T. 

Proof. From equations (fTTD and (I2U]) . R}J^{1-L) = In 

particular, for every 'ip,(p E RfJ^ifH), there exist f and g E R = such 
that 


if = $A^/^$*g. (24) 

From equations ffT7|) . fl^ and fl24|) 

Q*Qmcfi) = {QW,Qif))^. 

oo oo 

= Y1 Vfc = Y1 

k=l k=l 

oo 

= J2^kSk = (f, g)j^n = Irf"(f)(g) = (25) 

k=l 

where 1h^ denotes the identity operator on H'^. From fl24)) and fl2^ . equations 
(|22|) and fl2^ are obtained. 

Remark 4 In the following development we will assume that the eigenvector 
system {(fk, ^ > 1} and the matrix sequence {A^, k>l} are known. Thus, 
we address the problem of least-squares estimation of -valued parameter 
f3, under suitable conditions on the fixed design matrix X (see Section\^. In 
the case where e is defined by a system of stochastic partial differential or 
pseudodifferential equations (see Subsection \2.1\) . equations /[Id\)-I[ll\) show 
that the functional entries of the covariance matrix operator 0 are given 
in terms of the eigenvector system of operator C (which is known), and the 
eigenvalues of C, transformed by the continuous functions f, i = 1 ,... ,n, 
defining the system of stochastic differential or pseudodifferential equations 
0). Covariance operator estimation has been addressed in and 1^/ . 

3. Generalized least-squares estimation in the RKHS norm 

It is well-known (see, for example, j^, pp. 12-13) that the RKHS 'H(£) 
of e is dehned as the closure of in the norm || • ||^-i induced by Rff. 


11 




From Lemma [H 

||Y - X/3||^_i = R;;(Y - X/3)(Y - X/3) 

= $*R-^$($*(Y - X/3))($*(Y - X/3)) 

OO CO 

= ^ |Yi - |x/3]t|’'|Y, - |X/3|,] = Y1 ll®‘(/3t)llL., (26) 

k=l k=l 

where, as before £ = Y — X/3, and Sk{l3k) — — [X/3]fc] = ^^(Y — X/3), 

k > 1. Equation fl2BD is minimized if and only if, for each /c > 1, the norm 
II ■ |L-i of £fe(/3fc) is minimized. For each fc > 1, the minimizer of ||£fc(/3fc)||^_i 
with respect to (3^. is given by the generalized least squares estimator 

, Kf = (X^Afc'X)”iX^A“'Y,, k > 1. (27) 

Hence, the corresponding approximation of the functional vector parameter 
(3 is obtained from fl27)) by considering 

( OO OO \ ^ 

• • •, I • (28) 

k=l k=l ) 

Under Assumption AO, equations fl26|) - (l28|) provide a statistics minimizing 
the functional mean-square error, computed in the RKHS norm of 77(s). This 
statistics will dehne an estimator of parameter f3, hence, a generalized least 
squares estimator, if the following condition is satished: 

OO P OO 

EX®. = E [(X^A^'X)-‘X’'Aj‘yJ < 

k=l i=l k=l 

(29) 

i.e., if /3 G H^, with being the functional parameter space where /3 
takes its values. The following proposition provides a sufficient condition 
that ensures that the statistics given in (|28|) is a generalized least-squares 
estimator for functional parameter vector (3. 

Proposition 1 If 

OO 

trace (X^A^^X) ^ < cx), (30) 

k=l 

then, equation (d^) is satisfied a.s. Consequently, (3 in equation (d^) defines 
a generalized least-squares estimator for (3. 
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Proof. Under condition fl5U]) . since ||/3|||^p = YlT=iPkl^k < obtain 

(oo p \ oo 

E E ^ (YrA^'X(X^A,-'X)-‘(X’'A^T‘X)-‘xX"‘Yi) 

k=l i=l ) k=l 

oo 

= Y, trace (A^'X(X^A,-'X)-‘(X^A^T‘X)-‘X^A,-'Ae) 

k=l 

oo 

+ E'3tX^tV,-‘X(X^A^T‘X)-‘(XfAt‘X)-‘XfA,-‘X/3, 

k=l 


= ^ trace (Aj ■X(XfA,'‘X)-'(X^A,-'X)-'Xf) +/3f ft 

k=l 

oo 

= 5^trace(XfAj‘X(XX''X)-'(X^A,-‘X)-‘) + ml, 

k=l 

oo 

= ^trace(X^A~^X)"^ + ||/3||^p < oo, (31) 

k=l 


where we have used the well-known formula 


-^'[y^Qy] = trace(QV) (32) 


for a given symmetric matrix Q, but not necessarily positive dehnite, with 
y being a random vector whose mean is fi, and whose variance-covariance 
matrix is V = U'[yy^] — (see, for example, j^, M])- Therefore, 

Y7i=i f^ki < ^ particular j3 G a.s. 


Remark 5 The sufficient condition / T^) restricts our class of fixed effect 
design matrices to those ones preserving the trace property m of the infinite 
series of matrices {A^, k > 1}. In particular, in the case where X is the 
identity matrix ^ < oo. 

Also, if X. is a unitary matrix such that XX^ = I, then, condition 
assumed in Proposition [I] is also satisfied, since 

OO OO OO 

^ trace (X^A^'X)-' = trace (XX^A,-’)"' = ^ trace (A^) < oo. 

k=l k=l k=l 
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4. Functional analysis of variance for the transformed data model 

Let us first compute the residual error sum of squares SSE. From defini¬ 
tion of (3 in equations (HT} and fl28|) . we have 


y-x3 


* ((Y^ - X(xX"‘X)-'xX^'Y,))^^j) 

<!> (((I„x„ - X(X^A,-'X)-‘X’’AP) 



. ^=1 


oo 


-E 


n 

A4fc(w,f)Yfci 

i=l 


(33) 



where, as before, Inxn is the n x n identity matrix. 

From Lemma [T] and the residual error sum of squares (SSE) is 

computed in the geometry of the RKHS of e as follows: 


SSE = /y-y,y-y\ =/y-x3,y-x3\ 

\ / R7e \ ! Rll 

= r,-'(y-x3) (y-x3) 

oo 

= y^[A4,Yfc]^A^iA4fcYfc, (34) 

k=\ 


where, for each fc > 1, A4fc is given in equation ([33]). Note that (Y — X/3, Y — X/3)^-i ~ 
Xk ~ X^(’^), /c > 1. In addition, since, under Assumption AO, 
from Lemma m the total sum of squares (SST) is given by 


SST = (Y, Y)„,-. = fly (Y) (Y) = 5^ YJA^t'Y j, (35) 

k=l 


it follows that the hrst two moments of SST are not finite, i.e., 

OO 

E[SST] = E trace (A,-'At) +/3^X^A^‘X/3 = OO 

k=l 

oo 

Var (SST) = Y. 2trace (At'AtAt'At) +4/3^X^At‘AtAt'X/3 = OO. 

k=l 
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Hence, we consider a linear transformation of the functional vector Y in 
equation ([2]) to ensure that the corresponding total sum of squares (SST) is 
almost surely finite. Denote by W : if” —> if” such a transformation, thus 


Y = WY(-) = WX/3(-) + W£(- 


(36) 


4.I. Conditions on W for a.s. finiteness of functional variance components 
In the construction of the functional entries of W, we consider the resolu¬ 
tion of the identity in if given by 4 >k, with {cfk, ^ > 1} denoting, 

as before, the common eigenvector system of the covariance operators Rete , 
i,j = 1,... ,n. Note that such eigenvectors are assumed to be known (see 
Remarks]). Specifically, the weight matrix operator W will be of the form 


W = 


—1 ^kllfik C) (pk 


_ I —1 Wknlf'k ® (pk 


i —1 ^klnfik ® fik 


I —1 '^knnP^k ® f^k _ 


(37) 


For the almost surely finiteness of the total sum of squares from equation 
), W must satisfy 


OO 

E 

k=l 

OO 

E 

k=l 


OO 


trace (AsWjA^'Ws) < 

/3lX^WjAs‘WsX/3s < OO, 


(38) 


with = Wfc = {wkij)ij=i,...,n, for each k > 1. A sufficient condition 

for fl38l) to hold is that 


trace (Wl"As'Ws) < 


OO, 


(39) 


k=l 


since from equation (IT^ . trace (A^) < oo. In addition, we restrict 

out attention to the matrix operators satisfying fl37|) - fl38|) and admitting an 
inverse matrix operator : ff” —)■ ff” with WW~^ = In-n-- 

One can easily check that the total sum of squares SST for model 
is almost surely finite under fl38|) . i.e.. 


< oo. 


f;[s^] = E trace (WCAs'WsAs) +/5rx’’Wl’As‘WsX/3, 


k=l 
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For illustration purposes, we briefly describe a simple way for the construction 
of weight matrix operator W satisfying fl39p . 

4-1.1. Construction ofW 

Let us start assuming as given in Remark 0] that {0^, A; > 1} and 
{A., k > 1} are known. Then, for each k > 1, we consider the spectral 
diagonalization of matrix in terms of its eigenvectors {'ijjki, i = 1,... ,n} 
and eigenvalues {a;p(Afc), p = 1,..., n}. That is, for each k > 1, 

Ak = ^kClkiAk)^l, (40) 

where Q,k{Ak) is a diagonal matrix whose non-null elements are ujp{Ak), 
p = and where = Inxn, with having as columns the 

eigenvectors of A^. For each k > 1, matrix can then be constructed in 
terms of matrix as follows: 

Wa, = (41) 

where is a diagonal matrix whose non-null elements a;p(WA;), p = 

1 ,... ,n, satisfy the following condition: As fc —?■ oo, 

a;p(Wfc) = O , (42) 

with p(p) > 1, for every p = 1,... ,n, andci;p(AA;) > C(A:,p), with C{k,p) = 
O , k —)> oo, p = 1,... ,n. A direct example of matrix QkO^k) is 

obtained from condition fl42|) by considering Up(Wk) = , with p > 1, 

for p = 1,..., n, and for each A: > 1. 

We can also simplify the conditions required in the construction of W by 
the choice of parameter p(p) independently of p, with p > 1. Since from ([T9]) . 
Er=iE;=i^p(A.) < oo, let, for each A: > 1, pkiAk) = minp=i^..._„ cUp (Aa,) , 
where pk{Ak) > C{k), with C{k) = 0{k~P), for certain p > 1, as A; —)■ oo, 
one can consider 

max ujpiyVk) < Mk~^, P > 1, P > 1, (43) 

p=l,...,n 

for certain M > 0. Note that parameter p also characterizes the order of 
divergence of the sequence Jlk{A'^^) = maxp=i„ cUp (A^^) , A: > 1, since, 
for each A: > 1, the eigenvalues Up (A^^) , p = 1,..., n, of A^^ are given by 
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4-2. Almost surely finiteness of the functional components of variance 
Proposition 2 Under Assumption AO, and conditions KWi) and (42) (re¬ 
spectively, UE), for W satisfying = W^, we have E[SST] < oo. Con¬ 
sequently, SST is almost surely finite. 


The proof of this result is given in Appendix A. 

The sum of squares due to regression (SSR) for the transformed data 
model is given by 


SSR = ^ = R(({Y)(Y) - (y - Wx3) (y - Wx3) 

OO 

= E YrwI'A^'- YlWlMlApMtWtYt 

k=l 

oo 

= EYnwI'A^'Wj-Wl’A<^Ap>liWj]Yj. (44) 

k=l 


For the almost surely hniteness of the expected sum of squares due to regres¬ 
sion it is sufficient to consider 


a;p(Wfc) = O [k-^p(pl+^C))^ , k^oo, (45) 

in equation (IT2]) (respectively to consider maxp=i„ cUp (W^) < Mk~P^P, for 
p > 1 and p > 1, in fH3|) h In particular an example of matrix operator W 
can be constructed from the identity ujpfWk) = for p = 1 ,... ,n, 

and k > 1, where p{p) and g{p) are given as in Section [4. 1.1 1 This construc¬ 
tion of W ensures that trace (A^^W^) < oo, leading, under suitable 

additional conditions, to A'[SSR] < oo, as given in the following proposition. 


Proposition 3 Under Assumption AO, and conditions (3^) and [j^^for 
W satisfying = W^, we have A'[55R] < oo. Consequently, SSR is 
almost surely finite. 

The proof of this result is given in the Appendix B. 

Finally, the almost surely hniteness of SSE follows from Propositions [2] 
and[3l as proven in Appendix C. 
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5. Infinite-dimensional distribntion of the fnnctional components 
of variance 

This section provides the moment generating and characteristic functio¬ 
nals of the statistics SST, SSR and SSE. 

5.1. Moment generating functions of the variance components 

The following result establishes sufficient conditions for the existence of 
the moment generating functionals of the statistics SST, SSR and SSE, in 
the transformed functional data model. 

Theorem 1 Let us consider that Assumption AO, and eguation are 
satisfied. Assume also that W, constructed in ra, is strictly positive def¬ 
inite, and that eguation ( [73| j to hold. Furthermore, for each k > 1, the 
elements of the eigenvalues systems 

{6 (WjA-'WfcA,) , * = 

{6 (WjA^'X(X^A^'X)-iX^A^iWfcAfc) , z = l,...,n}, 

{6 ((W^A-^W, - WlA-^X{X^A-,^X)-VA-,^W,) A,) , z = 1,...,n} 

of matrices WfA^^WkAk, WfA^^XiX^A^^Xy^X'^A^^WkAk, and 
{WfA^^Wk - W^Afc^X(X^Afc^X)-iX'^Afc^Wfc) A^, respectively, are con¬ 
sidered to be strictly less than one. Then, the moment generating functions 
of S^, sMl and are given by 

M^(t/2) = E[exp(t/2(^)] 

OO 

k=l 

X exp (Inxn - (Inxn " A"'WfcAfc)-') A^^Xf3,^ 

( 46 ) 
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M^(t/2) = E[exp{t/2{SSR))] 

oo 

= n [det (I„xn - tW^A^iX(X^A-iX)"iX^A-iWfcAfc)] 
k=l 

X GXp ^ —/3^ X (Inxn (Inxn 

-(WfAj'X(XX“>X)-'X’-Aj'W,AO-')A,-‘Xft) 

(47) 


Mgg^(tl2) = B[exp(«/ 2 (SSB))| 

CX) 

= n (I,.xn - i (W^A^‘Wt - WjAt->X(X^At'X)->X^At->Wt) A^)] 

k=l 

X 6Xp ^ (Inxn (Inxn 

-i (W^Aj-‘Wt - W2’A^‘X(X’’A^ ■X)-'X^A^‘Wt) At)-') A^T‘Xft) . 

(48) 

Proof. We will apply that for a ?7. x 1 Gaussian vector y ~ X(/^, S), the 
moment generating function of y^Ay admits the following expression (see, 
for example, [^, pp. 600-608): 

A'[exp(f(y^Ay))] = [det (I„xn - 2tAS)]"^'^^ 

X exp - (Inxn “ 2tAS)"^)S~V^ • (49) 

In addition, under Assumption AO, the elements of the sequences 

YjW^A^'WfcY,, k>l, (50) 

and 

YlWlMlA-^MkW.Y,, k > 1 (51) 

are mutually independent. Then, for each k > 1, applying fj4^ to n x 1 
Gaussian vector Y^ ~ Af{[X.f3]k, A*,), and to matrices 

^‘sSR ” W2'At'X(XX''X)-'X^At'Wt 

A|gj, = (WjAt’‘Wt-WrAyX(X^At-‘X)-'XX"'Wt), (52) 
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playing the role of matrix A, for each element of the inhnite series dehning 
SST, SSR, and SSE, respectively, we obtain equations dlSD, and fHS]) 
from the independence of the elements of the sequences (1301) and (I3T]) . 

In equation (HOD , the inhnite product [^1^^ (inxn — 
is hnite since it provides the negative square root of the Fredholm determi¬ 
nant of operator W*R~^WR^e at point t. From condition (|45D . operator 
w*r;^wr,, is in the trace class (see also equation (1^ and Appendix A). 
Hence, its Fredholm determinant is hnite for 

(53) 


t < 


trace {w*r;^^wr,,) 


(see, for example, [5^, Chapter 5, pp. 47-48, equation (5.12)). 

In a similar way, it can be proved in equation (147)) that the inhnite prod¬ 
uct nr=i [det (Rxn-tW^A^iX(X^A^iX)-iX'^A^iWfcAfc)]“'/' is hnite, 
since it provides the negative square root of the Fredholm determinant of 
operator W*i?“JX(X^i?“JX)'^X^i?~g Wi?ee, at point t. Note that, again, 
from (l45l) . under (l30|) . operator 


w*r;;x(x^r;;x)-'x^r;;wr,, 

is in the trace class (see Appendix B), and hence, its Fredholm determinant 
is hnite for 


t < 


trace 


(64) 


(see, for example, [55|, Chapter 5, pp. 47-48, equation (5.12)). 

Finally, in equation (148|) . the negative square root of the Fredholm deter¬ 
minant at point t of the trace operator 

(w*r;;w - w*r;;x(x^r;;x)-'x^r;;w) 

is given by 

OO 

n [det (I„x„ - i (WjAy Wt - Wf ApX(X^A,-‘X)-‘X^Aj‘W^) A^)] 

k=l 


which is hnite for 


t < 


trace ({WRjjW - Wil„'X(xril„‘X)-iX^B,-'W) B„) 


( 65 ) 
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(see, for example, [5^, Chapter 5, pp. 47-48, equation (5.12)). 

We now study the hniteness of the second factor at the right-hand side 
of equations fl46|) . fl47)) and fl48|) . given in terms of negative exponential func¬ 
tions. Specihcally, in equation fl46|) . consider 


t < K 


SST maxfc>i; ^ W^A^) 

1 
X 


1 - maxfc>i; (W^Afc^WfcAfc) 


(56) 


where, as before, for each k > 1, ^i{Ak) denotes the Ah eigenvalue of n x n 
matrix A^, appearing in the series representation of a matrix operator A 
dehned on "H = if", such that = (Afc)^>j^. Since 


K. 


< 


SST - (Wj'Aj'WtAt) 


1 - fi (WfApWiAi) 


for every i = 1,..., n, and k > 1, ior t < we obtain 


exp j ^ ^ X (ifixn (Inxn 


k=l 


I “o 


k=l 2=1 
oo n 


1 - 


tWlA~^W,A,)-^) A-^X(3, 
1 


l-f6(W^A^iW,Afc) 


6 (A.-^) 




k=l i=l 


1 - 




1 - 




(Wi’A.-^W.Afc) 


6 (Ap) 


exp --X]/3tX^W^ApW,Xft , 


k=l 


(57) 
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where, for each fc > 1, is the projection operator into the eigenvectors of 
Afc, appearing in equation (HCT]) . Also, for each k > 1, and for i = 1,... ,n, 
k]i denotes the ith projection of the nx 1 vector [X/3]fc with respect to 
the Ah eigenvector of A^. Note that we have applied that, for each k > 1,'Wk 
has been constructed from the same eigenvector system as A^, (see equations 
(HO]) and dUD). In particular, (WjA~^WfcAfc) = (W^A^^Wfc) (Afc). 
Finally, equation flFTD is finite from condition (USD , which implies 

OO 

trace (W^A^^W^.) < cx). 

k=l 


From equations and fISBD . denoting 


IT 


SST trace {W*R-^WR,^) ’ 


(58) 


we have that is hnite for every t < minlAr—;^, IT,;:; 7 :r^|^ An an- 

SST^ ' m SST-' 

alytic continuation argument (see |^, Th. 7.1.1) guarantees that 

dehnes the unique limit moment generating function for all real values of t. 

Similar arguments to equation fl4^ can be applied for the proof of the 
finiteness of the second negative exponential factors in equations (H7)) and 
fl48p . as well as for the existence of the moment generating functions given in 
such equations. The details can be left to the reader, since they can be ob¬ 
tained straightforward from the above-described steps by replacing, for each 
k > 1, matrix W^A^^WfcAfc by matrix W^Afc^X(X'^A^^X)-iX^A^^WfcAfc, 
in the case of equation fH7)) . and, in equation fHHj) . replacing it by matrix 


(W^ApW, - wrApX(X^ApX)-'X^ApW») A 


k- 


5.2. Characteristic functions of the variance components 

In the derivation of the results in this section, we apply Proposition 1.2.8 


of Chapter 1, p.l4, in j22|, where the characteristic function of quadratic 


forms defined in terms of symmetric operators, and Hilbert-valued Gaussian 
random variables is provided. This result is formulated in Lemma |2] below, 
for the special case where the Hilbert space considered is "H = FT”. 
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Lemma 2 Let Y be an T-L-valued zero-mean Gaussian random variable with 
trace covariance matrix operator■ LG M 6e a symmetric matrix operator 
onLL. Assume that HRyyMRyyIUcw) < 1; where || • \\c{h) denotes the norm 
in the space of bounded linear operators on Ti. Then, for h eTL, 


exp(-(MY,Y>„ + (b,Y)„ 


det (I — RyyMRyy 


, 1/2 


1 - 1/2 


X exp - 


I - RyyMRVy 


) ^^^R^Yb 



wj 


(59) 


The next result establishes sufficient conditions for the explicit dehnition of 
the characteristic functionals of SST, SSR and SSE. 


Theorem 2 Under Assumption AO, and conditions and the 
following assertions hold: 

(i) The characteristic functional of SST is defined as 

exp (icuSST^ 




J] I det (l„,„ - 2!ijApW/Aj‘WtA 


1/2 

‘■fc 


1 - 1/2 


k=l 


X 


exp I -W^l3l:sXwlApWeAlF(l 


k=l 


-1 


■2*x,APwf Aj‘W» aP ) AfwlA-pWeXd, 


X 


exp J]/3/X^wX-‘W»X/3, 


k=l 


(60) 


(a) The characteristic functional of SSR is given by 


OO 

^Inxn 


exp (iuSSR 


2^a;AfwrA-iX(X^A-^X)-^X^A-^W,Af 


k=l 


- 1/2 
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oo 


X exp -4x,= ^/3^'X^WrAj‘X(XX-'X)-‘XX-'WtAf 

\ k=l 

X - 2iu,Af WfA^:‘X(X^Aj‘X)-'X^A^‘WjAf 

xAfwrA^‘X(X^Aj‘X)-‘X’'A^‘WtXft) 

xexp |'»a.^/3rx^WjA^'X(xXT‘X)-'X^A^'WjX/3A . 

(61) 


(in) The characteristic functional of SSE can he expressed as 


^= E exp (^iuSSE^ 


k=l 


X 


J] I - 2iujAf {WlApWt 

-WlApX(X^ApXr^X^ApW,) A 

XD 

exp(-4x,^X]/3jX^(W^A^‘We 


1/2 

k 


1 - 1/2 


k=l 


-'^lApX(X'^Apxy'X'^ApW,) A 

X fl„x„ - 2 !wA;/" (WlAr'Wi 


1/2 

k 


1/2 

‘■fc 


-WrApX(X^A^T‘X)-‘X^A,-'We) aJ 
X aP (W/Aj‘We - W/A^‘X(X^A^‘X)-‘X’'A^‘W,) Xft) 


X 


exp I ice J2 /3/X^ {WlApW, - W/A^‘X(X^Aj‘X)-‘ 

xX^’A^-'We) Xft). 


fc=l 


( 62 ) 


The proof can be found in Appendix D. 


24 





6. Linear functional hypothesis testing 


Consider the null hypothesis 


Ho : K/3 = C, 


where C G and K is an matrix operator from into satisfying 



■ Kn . 

. K^p ' 

K = 

^ml 

K 


k=l 


for f,g^H, and for i = 1,...,m, and j = 1,... ,p, in terms of the eigen¬ 
vectors <pk, k > 1, of the functional entries of Reg. Thus, we restrict out 
attention to test some contrasts on the functional components of /3, in terms 
of the class of matrix operators K such that, for each / > 1, = K/, 


Kz 


... Az(JCp) 


(64) 


Remark 6 Since the developed Functional Analysis of Variance in a multi¬ 
variate context is referred to the orthogonal basis of H, {0^, k > 1}, which 
is assumed to be known (see Remark\^ and Section \2H\) . a natural way of 
defining possible linear transformations K of our functional parameter vector 
(3 G HP, to test some contrasts, is given by with = K;, fori > 1. 


Lemma 3 The generalized least squares estimator (3 defined in equations 
satisfies ~ J\f{^l{f3), (X^A^^X)”^), for each k > 1. Under 

condition this estimator is a Hilbert-valued Gaussian random variable 

(HP-valued random variable), with functional mean (3 and trace covariance 
operator Q such that, for each k >1, = (X^A^^X)“h Equivalently, 


Q = 


I —1 Qkl()k ® 


;— 1 Qkplf'k ® ()k 


Qklp(pk 


i —1 Qkpf^k ® 4^k _ 


where, for each k > 1, Qki represents the ith diagonal element of matrix 
(X^A^^X)”^, i = 1 ,... ,p, and qkij and gup, with qkij = qkji, denote its {i,j) 
and (j, i) entries, i ^ j, and i,j = 1 ,... ,p. 
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The proof directly follows from classical generalized least-squares theory (see , 
for example, and ^|), and from condition (ISU]) (see, for example, 
pp.8-17. Chapter 1). 

Note that = C/ represents a m x 1 vector for each I > 1. Hence, 

for each k > 1, <h^(K/3) = [K/3]fc = Cfc. As a direct consequence of Lemma 
[31 the following result is considered (see, for example, and 53|). 


Lemma 4 Under the null hypothesis Hq : K/3 = C, for each I > 1, 

follows a chi-squared distribution with m degrees of freedom. 

LemmajH allows the application of an extended version of the hnite-dimensional 
hipothesis testing approach for functional data proposed in jl7|, based on 
the formulation of Cramer-Wold theorem derived in [l^. In our multivari¬ 
ate infinite-dimensional one-way ANOVA, the random vectors should be se¬ 
lected from a Gaussian distribution on the Hilbert space "H = with 
non-degenerate m-dimensional projections. 

The next proposition allows the application of Lemma [2] for the formula¬ 
tion of a functional linear test. 

Proposition 4 Assume that condition ^3S\j holds, and that matrix operator 
K is such that 


Then, under the null hypothesis Hq : K/3 = C, the test statistic 


(65) 


K/3 - C, K/3 - C 


■H=H^ 


J201 - 0ifKjKS, - A), 


1=1 


has characteristic functional given by 


E 


exp ia;(K/3-C,K/3-C 


■H=m 


= E 


exp iu ^(3/ - ^ifKjKi0i - f3i 
\ 1=1 /. 

J] [det{lp^p - 2*a;(X^Ar'X)-i/2KfK/(X^Ar'X)-'/2)]-'/2 .(66) 


1=1 


Here, as before, (3i = 4’/(/3), and = K/, for each I > 1. 
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The proof of Proposition 0] directly follows from Lemmas [2] and [21 under 
condition fl65p . considering M = 2ia;K*K and Y = /3 — /3 in Lemma [21 

Theorem 3 Assume that the conditions considered in Proposition hold. 
Then, for testing Hq ; K/3 = C versus Hi : K/3 ^ C, at level a, there exists 
a test given by: 




1 tf SHo{Y)>C{Ho,a), 
0 otherwise. 


Hem, S„.(Y) = (kS - C,k3 - H,). 

The constant C{Ho,a) is such that 

¥{SH,{Y)>C{Hii,a),Kp = C} = 1 - P{^Ho(Y) < «), K/3 = C} 

= 1 - F« = a, 

where the probability distribution F on H = iL” has characteristic functional 
given in eguation TUBi) of Proposition^^ 


7 . Final comments 


Our approach allows the identification of the functional components of 
variance SST, SSR and SSE with series of independent finite-dimensional 
random quadratic forms, respectively constructed from a sequence of inde¬ 
pendent multivariate (n-dimensional) Gaussian random variables (see The¬ 
orem [2D. The elements of such a multivariate normal sequence respectively 
dehne the n-dimensional projections of the inhnite-dimensional multivariate 
Gaussian measure on TL = underlying to our studied Hilbert-valued 
fixed-effect Gaussian model with correlated error components. New func¬ 
tional hypothesis tests, in the spirit of classical one way F-ANOVA test, can 
be formulated from such identihcations, applying an extended version of the 
methodology proposed in 17| for independent functional data. 

The example given in Section 12.11 can be applied to different practical si¬ 
tuations. Specifically, in the geophysical context, the response can be referred 
to time (respectively, to space), i.e., the response takes its values in a sepa¬ 
rable Hilbert space of vector functions with temporal support (respectively, 
with spatial support). In such a case, equation ([9D represents the physi¬ 
cal law governing the evolution in time of the vectorial random source or 
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multivariate innovation process (respectively, describing the spatial diffusion 
of the vectorial random source or multivariate spatial innovation), at each 
station (for example, heat transfer equation at each meteorological station, 
under different climatological conditions, e.g., considering seasonal factors, 
location factors, etc.), in the heterocedastic and correlated settings (see, for 
instance, j^, for a mixed-effect spatiotemporal process formulation applied 
to meteorology). In human tactile perception (see, for example, (^), for 
i = 1,..., n, operator /«(£) can define the movement equation describing the 
path of the random stimulus applied to the ith subject, under different ex¬ 
perimental conditions, which can affect the perception of the subject. Here, 
the applied random stimuli interact or are correlated between different indi¬ 
viduals. Other possible fields of application of the proposed Hilbert-valued 
Gaussian fixed effect model with functional correlated noise can be found in 
the statistical analysis of functional magnetic resonance imaging data (see, 
for example, (4ol |. and the references therein), disease mapping (see, for ex¬ 
ample, [52|), and in spatiotemporal environmental processes (see j59|h 

Alternatively, the semi-parametric class of covariance matrix operators 
introduced in ([S]) can be reformulated in a more flexible way, by consider¬ 
ing an extended definition of the matrix sequence {A^, k > 1}, given in 
flT^ . Specifically, in (1T6|) . a separable correlation structure between random 
variables {rjki, k > 1} and {r]kj) k > 1}, for i ^ j, and i,j G {1,... ,n} is 
considered, ensuring, from equations ([T5]) -f[T ^ , that trace (^^j^ A^.) < oo. 
In a more general framework, we can consider, for i ^ j. 


^[VkiVpj] ^k,pf(^^kii^kjikj')i 


(67) 


with / being a function such that the matrix A^ is of full rank, for every 
k > 1, and condition flT^ is satisfied. 

Extensions of the formulated results to the framework of Hilbert-valued 
fixed effect models with autoregressive correlated error components can be 
obtained from the presented methodology and the results derived in and 
in the temporal autoregressive case, as well as the results given in 
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and (5l|, in the spatial autoregressive case. However, in the ET-valued multi¬ 
variate time series framework, the assumption on the existence of a common 
resolution of the identity could exclude some interesting cases. Hence, further 
research is required to obtain a more flexible setting of assumptions. 
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Appendix 

In the following, Appendices A-C provide the proof of the almost surely 
hniteness of SST, SSR and SSE. In addition, Appendix D gives the proof of 
Theorem m and Appendix E shows an example of the Hilbert space structures 
that can be considered under Assumption AO. 


Appendix A. Almost surely finiteness of SST 

Proof of Proposition [H 

Let us denote T(W^,, A^.) = trace (W^-ApWi) and T(Afc) = trace (A^). 
Also, the notation ||X/3||^^_i^ = ^ /3fcX^W^Afc^WfcX/3fc will be used. 

Applying CauchySchwarz inequality, and Parselval identity, under fH2|) (re¬ 
spectively, (l43ll ). we obtain 


k=l 


k=l 


E[S^] = trace (W^A^'W.A,) + ||X/3||^^_i^ < r(W,, Afc)r(A, 

+ IIX/3II? 


iwijriw — 


< 


\ 



\ k=i 


WR-fW 


E E A01"/3rx^X/3, 


k=l 


\ 


k=l 


k=l 


< 


E[7'(A»,)l'El'^(W,,A,)f + 

\ k=l 


k=l 


\ k=l 


k=l 


which hnite, since, under fl4^ (respectively, fl43|) j. k, Ak)]"^ < 

CEZiTiWk^Ak) < cx), and since X/3 E PL = FT"', then [/3feX^X/3;j] ^ < 
C\\Xf3\\ 

h=H" = c'Er=i/3rx^x/3, < oo, for certain positive constants C 

and C. 
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Appendix B. Almost surely finiteness of SSR 

Proof of Proposition 0 
Let us compute 


E|SSR] = J2e [YjlWfAj‘Wt - WlMlApM,Wt]Yt] = E 


-E 
= E 


k=l 


I Vir 

I ^ A\R7}Ai.'MV 


SST 


= E 


SST 


- r {WM^R^^MWR,^) - IIX/3II 


WAl^-RJe AlW 


SST 


- r (w, A-', A) + r (W, X,A-\A) - ||X/ 3 ||; 


( 68 ) 


Vir 

IIWA4-Ree A4W 


where E 

T (’WMT'R-^M'NR,,) 


= Y.ZiE[YlWlMlApM,-W^Y7\ , 

Er=i trace {WlMlApM,Yf,A,) , 

= Er=i 0,X^YilMlA-pMtW,X0„ T (W, A-', A) = 
EEittiiceWA^tWtA,) , and r (W, X, A) = 

Er=i trace (W^A-iX(X^A~iX)-iX^A~^W,A,) 

Note that, under condition (H5|) . since = W^, YlT=i trace 
is hnite. Moreover, applying again well-known properties of the trace of the 
product of real and symmetric positive semi-dehnite matrices (see, for exam¬ 
ple, 13), and Cauchy-Schwarz inequality, we obtain 

T (W, X, A-\ A) < f (W, X, A-\ A) 


< ^ trace ((X'^A“^X)-i) trace (X'^A"^WfcWjA"^X) trace (A^) 

k=l 


< ^ trace ((X^A"'X)-i) [trace (A"^Wfc)] 2 r (XX^) T (A^) 

k=l 


< r (xx^) 

< ICT (xx^) 


^ [trace (Afc) trace ((X^Afc^X)-i)] trace 

\ k=l 


1 4 


k=l 


\ Er(A*) trace ((X^A^ ^X)-i) T {WR^, A"^) 

\ k=l 


( 69 ) 


< tCT (xx'f) 


Eir(Ajfr(x,A-‘) 


k=l 


1/4 


r(WV2,A~i) < oo. 
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under conditions flSP]) and fHS]) . where T(W,X, A A) 

= Er=i trace (W^A-'X(X^A-^X)“iX^A-iWfcA,) , f (W,X, A-\ A) = 

Er=i trace (W^A^'X(X^A^iX)-iX^A^^Wfc) trace (A^), 

r (XX^) = trace (XX^) , r (X, A~') = Er=i [trace ((X^A,'X)"!)] ^ 

and T A“^) = YlT=i trace . In addition, 


< ^/3tX^wrA^'WjX/3; 


k=l 


k=l 


< J2 [trace < 


k=l 


£ [trace (WX:'W*)]‘||X/3|| 

\ k=l 


n 


< JC 


i 


^ trace (wr'Aj'Wr)||X/3||„ < oo. 


(70) 


k=l 


since X/3 E 1-L = i/"", and trace (W^A^^W^) < cx), under condition 


. From equations (j68l) - (l7ni) . keeping in mind that, E 


SST 


< oo, as 


given in Appendix A, we have F'[SSR] < cx). Thus, SSR is a.s. hnite as we 
wanted to prove. 

Appendix C. Almost surely finiteness of SSE 

The a.s. hniteness of SSE follows straightforward from Appendix B, since 

OO 

E[S^] =J2e [Y^WlMlA^^MkWkYk] < oo, (71) 

k=l 


as given in equations dMD-dZOD. 


Appendix D. Proof of Theorem\^ 

The proof of Theorem [2] follows from Lemma [2l We now provide the 
main steps involved in the derivation of the characteristic functional of the 
components of variance for the transformed functional data model. 


(i) From Lemma 121 considering as 77"^-valued zero-mean Gaussian ran¬ 
dom variable, Y — X/3, and as matrix operator M = 22a;W*R“J^W, 
keeping in mind that <F^(Y —X/3) = Y^ —X/3fc, and <F^W*R”g^W$fc = 
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W^A^^Wfc, for each k > 1, we obtain, for ca < i? 
given in equation fl75]) below, 




with 


E 


exp 



Xf3,rwlA-^W,{Y, 



= n [det (l„.„ - 

k=l 


- 1/2 


(72) 


Hence, for 


Y-X/3+X/3||^,^..,^ = 5^(Yt-Xft+X/3J’'W/Ai:‘Wi(Yt-X/3t+Xft), 

k=l 


we have 


= E ^exp (^iwSSTjJ = E [exp (ia;||Y - X/3 + X/3||^r^_i^)] 

= E [exp {^UJ (W*R;;W(Y - X/3), (Y - X/3))^„^^ 

/ cx> 

+2ii*,(WR-/WXA (Y - X/3))„..„)] exp iieJ^/j/X^W/Aj'WtX/J, 


k=l 


k 

(73) 


Applying again Lemma [2] with Y 
sian vector, and, as before. 


-X/3 as hr”^-valued zero-mean Gaus- 
M = 2ia;W*R~^iW, and with 


b = 2ia;W*R^g WX/3, keeping in mind that 


n^ee^k = 
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and ^l{/3) = (3j^, for each /c > 1, we obtain from fl72ll and (173]), 


F^^iiui) = E l^exp ( iuSST) 


k=l 


J] Idet (l„xn - 2*a;Af WjA-'WfcA 


^1/2 


- 1/2 


X 


exp -41^2 J]/3/X^W/ApWtA 


1/2 

k 


k=l 


X (!„>,„-2!x.APw/Aj‘WtAj 


xA/^W/A^T'WtXft 


1/2 


-1 


X 


exp < oo, 


k=l 


(74) 


for XI < ““{-Sgoiji. ^^SST defined as in 

, and 


B 


SST 


2maxj,iJ. ( A/=W/A^'WsAf'' ’ 


(76) 


where, as before. 


JjIAPw/ApWsAP 


denotes the ith eigenvalue of matrix A^^^W^A^i, for i = 

1, ■ ■. ,n, and for each k > 1. An analytic continuation argument (see 


47l |. Th. 7.1.1) guarantees that dehnes the unique limit 

Oo X 

characteristic functional for all values of uj. 

(ii) Similarly, from Lemma lU for suitable u (see equation fl75]) below). 
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we have 


exp - X/3t)"'w2'AiT'X 

V k=l 

x(X’'A^‘X)-'X’'AiT‘W»(Yt - Xft))] 

oo 

H [det (l„xn - 2zujAI^^WIA]:^X 


k=l 


x(X’'A^‘X)''X^At‘W»Af 


- 1/2 


(76) 


Applying again Lemma [2] with 


and with 


M = 2ix.WR,-/X(X^R-/X)-‘X^R-/W, 


b = 2 !ipWR„‘X(X’’R„‘X)-‘X’’R-/WX/3, 


one can get, 


^ssr(“> = 


X 


exp mcuSSRj 


n [det (Rxn - 2*a;A^/'W^A^'X(X^A^iX)-'X^A^'WfcA 

k=l 

/ CX) 

exp -4e=£^/3/X^W/A^'X(X^ApX)'‘X^A,-'WtAf 


- 1/2 


k=l 


x - 2ix.ApW/At ■X(X’'Aj‘X)'‘X^A2"W,.A"''^ 

xAPwl’AyX(X’-A^‘X)-‘X’’AyWjXft 

/ OO 

exp ^a;5^/3rX^WrA^iX(X^A^'X)-iX^A^iW,X/3, | < oo, 


-1 


X 


k=l 


(77) 
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1 


for u < min{5^^, ITg^}, with 


IT 

B 


SSR 2trace 

1 


2maxfc,ie, fAi/'W^A-^X(X^A-iX)-iX^A-iWfeA 


1/2 V 


(78) 


where, as before, for i = 1,..., n, 

5.(Afw/A^‘X(X^AiT'X)-'X^A,-‘W,A, 

denotes the ith eigenvalue of matrix 


1/2 


A^/'A^^XfX^ A7^X)-^X^ A7^ W;, A 


1/2 


for each k>\. An analytic continuation argument (see Th. 7.1.1) 


guarantees that (*n;) dehnes the unique limit characteristic func- 

boH, 

tional for all values of u. 

(hi) From Lemma 121 for suitable oj (see equation flSTll below), we obtain 


E 


exp (W/A,T‘Wt - W/AyX(XXl‘X)-' 

V k=l 

xXX^'We) (Yi-Xft))] 

oo 

n [det (Cx„ - (W/A,-‘Wt - W/A^T■X(X^A,-‘X)-‘ 

- 1/2 


k=l 


X 


X^Ay Wt) A 


1/2 

k 


(79) 


As before, considering again Lemma |2] with 

M = 2iu (w*r;;w - w*r,-'x(x^r;;x)“'x^r;,iw) , 

and with 

b = 2*a; (W*R,-'W - W*R;;X(X^R,-iX)“iX^R,-'W) X/3, 
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we obtain, 


= E exp 


LXJ 

n (l">.n - 2iwAP (W^’ApWi 

-WjA^‘X(X’'ApX)-'XX"'W^) A, 


k=l 


1/2 

k 


1 - 1/2 


( oo 

k=l 

-WrA^'X(xXT'X)-'X^A^'W,) Af 

X 2ix)Ap {WlA^'Wt 

-W/ApX(X^Aj'X)-‘X’'ApWt) Af )■' 
xAf (W/ApWi - W/Aj‘X(XX-'X)-‘X’'Aj‘Wt) Xft) 

( OO 

lu, ^ Olx^ (W/ApWt - W/ApX(X^ApX)-' 

k=l 

xX^A-^Wfc) X/3,) <oo, 

( 80 ) 

for cj < min{5^g^, ITg^}, with 

IT- =-- 

SSE 2trace ((W*i^;^^W - W*R~llL{yJR-^W) R^e) 

1 

2max,,{. (aP (WJApWt - W/A^‘X(X»-ApX)-iX’-A^‘W^) Af) ’ 

( 81 ) 

where, as before, for z = 1,..., n, 

f, (aP (WfApWi - W/A,-‘X(X^ApX)-‘X’'ApWi) Af) 
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denotes the ith eigenvalue of matrix 




WrA,-‘X(X^AiT'X)-‘X^A,-‘W») A^ 


for each k >1. An analytic continuation argument (see ji^, Th. 7.1.1) 
guarantees that {ioj) dehnes the unique limit characteristic func- 

oorj 

tional for all values of oj. 
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